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tracking  test  errors.  ’“Pilots  wha  were  better  able  to  differentiate  different 
rates  of  expansion  of  a  test  flow  pattern  achieved  a  greater  percentage  of 
hits  and  misses  in  low-level  flight  and  bombing  tasks. "y  Aircraft  flying  grades 
correlated  with  flow  pattern  test  results. 
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r  'object  site  alone  are  effective,  but  the  presence  of  static  texture  dramati¬ 
cally  reduces  the  effectiveness  of  changes  in  object  site.  In  contrast' to  the 
traditional  emphasis  on  static  picture  quality  in  visual  simulation,  this 
finding  emphasizes  the  importance  of  dynamic  parameters  in  simulation  fidelity. 
In  terms  of  monocular  two-dimension  simulation  of  motion  in  depth,  our  findings 
suggest  that  in  many  conditions  the  presence  of  texture  reduces  stimulus 
effectiveness,  and  at  best  the  presence  of  texture  adds  little  to  the  effective 
ness  of  an  untextured  stimulus. 

Subjects  cannot  accurately  locate  the  center  of  expansion  of  an  expanding 
flow  pattern  in  the  presence  of  translational  motion  of  the  retinal  image  when 
there  is  no  accompanying  geometrical  distortion.  However,  subjects  are  very 
sensitive  to  geometrical  distortions  of  the  retinal  image ,  and  can  accurately 
judge  the  location  of  the  maximum  rate  of  object  magnification  even  in  the 
presence  of  translational  motion. ,^The  relevance  of  this  finding  to  aviation 
is  that  in  some  (but  not  all)  visual  environments  the  location  of  the  maximum 
rate  of  change  of  magnification  due  to  self-motion  approximates  the  observer's 
destination. 

We  have  found  nerve  cells  in  the  visual  cortex  of  cat  brain  whose  properties 
may  in  part  account  for  the  visual  channels  for  motion  in  depth. 

We  have  extended  our  findings  on  the  Williams  AFB  flight  simulator  to  real 
telemetry-tracked  aircraft  at  the  Yuma  TACTS  facility.  Success  in  air-to-air 
combat  (A4  versus  F-14)  and  low-level  bombing  accuracy  (A4  aircraft)  correlate 
with  laboratory  test  results  on  the  motion  in  depth  tracking  test  and 
expanding  flow  pattern  test,  and  also  correlate  with  the  results  of  two 
airborne  vision  tests. 
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(b)  LIST  OF  RESEARCH  OBJECTIVES 

(1)  Define  the  properties  of  visual  channels  that  are  likely  to  be  involved 
in  aviation. 

(2)  Define  the  visual  display  features  of  a  flight  simulator  that  contribute 
to  good  transfer  of  training  by  stimulating  the  visual  channels  used  in  real  flying. 

(3)  Find  how  visual  channels  for  form,  depth  and  motion  operate  when  the 
eyes  are  moving  and  when  the  angle  of  convergence  of  the  eyes  is  changing. 

(4)  By  testing  experienced  pilots  previously  rated  for  visual  flying  skills 
in  simulators  (e.g.  for  skill  in  close-formation  flying)  I  aim  to  identify  the 
channels  whose  test  results  predict  which  pilots  will  be  rates  as  outstanding 
(e.g.  top  5%)  on  visual  flying  skills. 

(5)  Having  identified  the  channels  whose  test  results  correlate  with  visual 
flying  skills  (Aim  #4)  I  aim  to  find  whether  the  sensitivities  of  these  channels 
can  be  improved  by  appropriate  training  procedures  (e.g.  by  simple  visual  exer¬ 
cises).  If  so,  I  aim  to  find  whether  these  improved  test  results  accurately 
predict  improved  visual  flying  skills  as  estimated  on  simulators. 

(6)  Design  new  tests  for  (a)  selecting  student  pilots,  and  (b)  monitoring 
the  visual  abilities  of  experienced  pilots  so  as  to  aid  in-service  retraining 
programmes  for  maintaining  an  adequate  level  of  performance.  These  tests  will 
measure  the  sensitivities  of  the  information-processing  channels  already  identified 
in  Aim  #1  as  likely  to  be  important  in  practical  flying. 

(7)  By  following  student  pilots  I  aim  to  identify  the  channels  whose  test 
results  predict  which  student  pilots  who,  having  passed  conventional  visual  tests, 
nevertheless  will  fail  to  acquire  adequate  visual  flying  skills. 
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(c)  STATUS  OF  THE  RESEARCH  EFFORT 
Background 

Visual  sensitivity  to  stereoscopic  motion  in  depth 

Tests  of  stereoscopic  depth  perception  have  traditionally  been  restricted  to 

assessing  an  individual's  ability  to  see  positional  (static)  depth,  and  assessing 

12  3 

stereoacuity  for  positional  depth  *  *  .  Similarly,  psychophysical  research  (in  man) 

and  single-neuron  studies  in  animals  have  focussed  almost  exclusively  on  positional 

4  5  6 

(static)  depth  perception  ’  *  . 

In  recent  years,  however,  the  problem  of  how  we  see  and  judge  motion  in  depth 

7 

has  attracted  growing  attention.  Richards  described  in  1973  a  subject  who  could 

hardly  see  sinewave  oscillations  in  depth  if  they  were  of  very  low  frequency,  but 

who  could  easily  see  them  at  1  Hz.  This  subject  might  be  described  as  having  lost 

visual  sensitivity  to  positiona.  (static)  depth  while  retaining  sensitivity  to  motion 

in  depth,  so  that  Richards'  observation  can  be  read  as  evidence  for  a  neural 

mechanism  specifically  sensitive  to  motion  in  depth. 

In  1973  Beverley  and  I  proposed  that  the  human  visual  system  contains  channels 

sensitive  to  motion  in  depth  that  respond  only  to  a  restricted  range  of  directions  of 

motion  in  depth  .  We  argued  that  there  is  a  separate  subsystem  for  processing 

motion  in  depth  in  addition  to  the  well-known  subsystem  for  processing  position  in 

depth.  As  evidence  we  cited  our  findings  that:  (a)  adaptation  to  motion  in  depth 

along  some  fixed  direction  in  depth  depresses  visual  sensitivity  to  motion  in  depth 

and  (b)  sensitivity  to  motion  in  depth  is  depressed  for  only  a  restricted  range  of 

directions  of  motion  in  depth.  For  example,  strong  adaptation  can  produce  temporary 

blindness  for  motion  in  depth  for  trajectories  directed  to  the  left  of  the  nose,  while 

not  affecting  visual  sensitivity  for  trajectories  directed  to  the  right  of  the  nose. 

First  note  that ,  when  looking  at  an  object  moving  in  three-dimensional  space, 
the  ratio  between  the  velocities  of  the  left  retinal  image  (V^)  and  the  right 
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retinal  image  ( V directly  gives  the  direction  of  motion  in  depth.  Figure  1 
illustrated  this  point. 


Figure  1.  Schematic 
diagram  illustrating 
the  motion  of  the 
images  on  the  left 
and  right  retinae  of 
a  binocularly -viewed 
stimulus  that 
oscillated  in  various 
directions  in  three- 
dimensional  space. 
(From  Ref.  #8) 


Figure  2  shows  threshold  elevations  produced  by  moderate  adaptation.  The 
stimulus  target  oscillated  along  a  straight  line  in  depth  at  0.8  cycles/sec  with  a 
sinewave  motion.  Ordinates  plot  the  amplitudes  of  depth  oscillations  that  could  just 
be  seen  before  and  after  adaptation.  Abscissa  plot  the  ratios  between  the 

velocities  of  the  left  and  right  retinal  images.  Abscissae ,  therefore ,  plot  the 
directions  of  motion  in  depth.  For  example ,  with  V^/V^  =  1:1  the  target  was  moving 
sideways,  with  =  -(0:1)  the  target  moved  along  a  line  through  the  left  eye , 

with  VjJ Vr  =*  -(1:1)  the  target  moved  along  a  line  through  the  nose ,  and  with 
*  -(1:0)  the  target  moved  along  a  line  through  the  right  eye. 

Figure  2  shows  that  there  are  at  least  two  channels  for  motion  in  depth,  one 
sensitive  to  motion  passing  to  the  right  of  the  nose  and  the  other  channel  sensitive 
to  motion  passing  to  the  left  of  the  nose.  Further  adaptation  experiments  revealed 
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Direct  ton  of  Motion  in  Real  Spec*.  (<*•») 


Figure  2.  Directional- 
specific  adaptation  to 
motion  in  depth.  Depth 
thresholds  (ordinates) 
versus  the  direction  of 
motion  in  depth  (plotted 
along  the  abscissa  as  VT/VjJ. 
Full  line ,  before  n 

adaptation;  dotted  line , 
after  adaptation  to  direction 
A;  chain  line,  after  adapta¬ 
tion  to  direction  B. 
Negative  sign  means  left 
and  right  retinal  images 
always  moved  in  opposite 
directions;  positive  sign 
means  they  moved  in  the 
same  direction. 


that  each  of  these  channels  was  made  up  of  two  others.  The  four  directional 
sensitivity  curves  are  shown  in  Fig.  3.  Note  that  the  inner  two  curves  are  so 
selective  that  they  do  not  respond  at  all  to  trajectories  more  than  1. 5°  away  from 
the  preferred  direction. 

Using  our  method  for  dissociating  the  perception  of  sideways  oscillations  and 
motion-in-depth  oscillations  we  showed  that,  for  threshold  signals,  the  bandpass  of 
the  motion-in-depth  subsystems  is  centered  on  a  much  lower  frequency  that  the  band- 
pass  of  the  subsystem  for  sideways  oscillation  *  :  the  stereoscopic  subsystem  is 

f 

very  sluggish.  These  conclusions  agree  closely  with  Richard's  findings  for  super¬ 
threshold  oscillations. 

Richards  and  I  provided  further  evidence  for  the  existence  of  stereoscopic 


subsystems  for  position  and  for  motion.  We  found  that  some  subjects  have  regions  in 
the  visual  field  that  are  blind  to  motion  in  depth,  but  where  static  depth  perception 
is  unimpaired:  this  implies  that  two  different  neural  activities  or  organizations 
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Left  eyet  Inom  tnight  eye 


Direction  of  Motion  in  Real  Space.  (deg)  j 
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Figure  3.  Sensitivity 
curves  for  four  hypothetical 
channels  that  underlie  the 
experimentally  determined 
plots  of  Fig.  2. 
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are  responsible  for  processing  these  two  different  types  of  visual  information  . 

Figure  4  illustrates  this  finding. 

Moving  from  psychophysical  level  to  single-neuron  level  Cynader  and  I10  have 
recently  found  that  many  neurons  in  cat  visual  cortex  are  preferentially  sensitive 
to  motion  in  depth  along  a  narrow  range  of  directions  (Fig.  5).  These  neurons 
"throw  away"  information  as  to  position,  while  emphasizing  information  as  to  the 
direction  of  motion  in  depth  (Fig.  6),  We  emphasized  that  previous  neurophysiologists 
had  not  found  these  neurons  because  they  did  not  look  for  them  (by  using  appropriate 
stimulation):  previous  workers  looked  only  for  position-in-depth  neurons.  Our 
motion- in-depth  cells  do  not  reveal  their  properties  unless  they  are  appropriately 


stimulated. 
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disparity,  obtained  using  a  1*  bar  oscillating  back 
and  forth  from  0  to  0.4*  disparity  twice  per 
second.  The  two  ovals  on  the  horizontal  axis  are 
the  blind  spots.  The  dark  regions  inside  the 
double-line  perimeter  indicate  regions  of  no  depth. 
(The  field  was  not  explored  beyond  the  perimeter 
shown.)  The  dotted  areas  are  regions  of  ambly¬ 
opia,  where  unstable  depth  sensations  could  oc¬ 
casionally  be  elicited.  The  cross  corresponds  to 
the  central  fovea.  Subject  DR. 


B  DIVERGENT 

Stereo  field  plot  for  a  divergent  stimulus 
disparity  for  subject  DR.  Except  for  reversing  the 
bars  presented  to  each  eye  (a  sign  reversal),  the 
stimulus  is  identical  to  that  used  to  obtain  the 
field  shown  in  A. 


Solid  curve  encompasses  the  region  of 
ie  visual  field  over  which  DR  can  see  a  0.4 
ivergent  stimulus  disparity  presented  as  a  100 
iscc.  flash.  Dashed  curve  is  same  stimulus  as 
sed  to  construct  D  except  that  the  oscillating 
ar  is  flickered  on  and  off  1.5  times  per  second. 


Figure  4.  From  Reference  #9 
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Note  that  the  motion-in-depth  channels  (or  neurons)  signal  "I  don't  know  where 

it  is  or  what  it  is,  but  it  is  going  to  hit  (or  miss)  you".  They  signal  this  with 

much  more  precision,  and  for  objects  at  much  greater  distances  than  could  be  done  by 

8  10 

the  classical  positional-depth  stereoscopic  subsystem.  We  pointed  out  ’  that 
this  subsystem  may  also  be  used  when  subjects  move  relative  to  the  outside  world, 
e.g.  when  landing  an  airplane  or  flying  in  close  formation  and  in  driving  an 
automobile. 

Turning  back  to  studies  of  human  performance,  Beverley  and  I  measured  human 
visual  ability  to  discriminate  between  two  direction  of  motion  in  depth*^.  We  found 
that  our  measured  discrimination  was  in  line  with  our  estimations  of  certain  acute 
oculmotor  skills  of  baseball  and  cricket  players  (0.2°  precision  in  discriminating 
the  direction  of  motion  in  depth).  These  data,  shown  in  Fig.  7,  might  be  read  as 
an  indication  of  the  limiting  precision  with  which  a  pilot  could  be  expected  to 
visually  judge  his  direction  of  flight  if  he  were  restricted  to  stereoscopic  motion 
cues  alone. 

However,  even  the  sharp  selectivity  of  our  proposed  stereoscopic  motion 
mechanisms  (e.g.  sensitive  to  only  a  1.5°  range  of  directions,  Fig.  3)  cannot  explain 
discrimination  so  exquisite  as  0.2°.  We  were  therefore  forced  to  propose  an 
additional  mechanism.  Our  discrimination  data  suggested  to  us  that  human  ability 
to  make  very  acute  distinctions  between  directions  of  motion  in  depth  is  based  on 
subtraction  mechanisms  (much  as,  in  colour  vision,  the  very  acute  human  sensitivity 
to  differences  in  wavelength  is  based  on  opponent-colour  subtraction  processes). 
Figure  8  is  a  psychophysical  model  that  outlines  our  ideas.  Note  that  the  binocular 

motion  filters  OR,  IR,  IC  and  OL  in  Fig.  8  have  now  been  associated  with  classes  of 

,  ,  .  _  .  „  *  10,13 

single  neuron  in  parastnate  cortex 


This  line  of  research  is  summarized  in  Reference  #12  and  Reference  #13. 
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LiU  eye  *  Riflh«  eya 


Fig.  5  Binocular  selectivity  for  the  direction  of  motion  plotted  in  polar  co-ordinates 
looking  down  onto  the  left  and  right  eyes.  Same  unit  as  in  Fig.  3.  The  number  of  spikes 
per  sweep  for  20  stimulus  cycles  at  37  deg/aeo  is  plotted  radially  on  a  linear  scale  (dashed 
line,  open  circles).  The  flne  continuous  line  (filled  circles)  shows  the  linear  Bum  of 
responses  to  separate  stimulations  of  the  left  and  right  eyes:  each  point  iB  based  on 
separate  empirical  measurements.  This  Figure  shows  how  the  inhibition  for  binocularly 
viewed  sideways  motion  (arrowed)  had  the  effect  that  appreciable  responses  were 
generated  by  only  a  narrow  (2“)  range  of  directions  of  motion  for  which  the  target  would 
either  hit  or  narrowly  miss  the  animal's  head. 

The  number  of  spikes  per  sweep  for  20  stimulus  cycles  is  plotted  radially  on  a  linear 
scale.  The  ratio  between  the  tpeeds  of  the  left  and  right  retinal  image  is  plotted  linearly 
round  the  circumference  of  the  circle.  For  explanatory  purposes,  the  corresponding 
angular  directions  in  real  space  are  also  shown,  in  this  case  for  a  viewing  distance  of 
143  cm  and  intei pupillary  separation  of  3-0  cm.  Note  that  this  angular  scale  is  very 
nonlinear,  and  emphasizes  the  2-4"  range  of  directions  that  pass  between  the  eyes  at  the 
expense  of  the  remaining  367  11°  range  of  directions  that  miss  the  head. 

Fig  A  unit  that  wax  preferentially  sensitive  to  motion  directed  between  the  eyes.  Tlie 
uuinlier  of  spikes  per  sweep  in  20  st  itnulux  eyries  at  37  deg/sec  is  plotted  logarithmically 
as  ordinates  versus  the  positional  disparity  between  the  left  and  right  bars  (plotted 
linearly).  In  this,  as  in  all  subsequent  Figures,  the  zero  of  disparity  is  arbitrary.  The  fine 
continuous  line  plots  the  lineur  sum  of  response  to  separate  stimulations  of  the  led  and 
the  right  eyes.  The  heavy  dashed  line  shows  that  responses  were  inhibited  tenfold  below 
this  linear  prediction  when  the  left  und  right  eyes  were  simultaneously  stimulated  with 
identical  movements  (i.e.  binocularly  viewed  sideways  motion,  cf.  Fig.  I).  The  arrow 
indicates  the  depth  of  this  inhibition  which  clearly  extended  over  a  broad  range  of 
disparities.  The  full  line  shows  that  no  such  inhibition  occurred  when  left,  and  right  eyes 
were  stiiuuiated  with  identical  speeds  in  opposite  directions  (i.e.  binorularly  viewed 
motion  directed  along  a  line  midway  between  the  eyes.  ef.  Fig.  I).  Thus,  over  a  large 
volume  of  space,  an  inhibitory  mechanism  eauwxl  this  unit  to  favour  motion  directed 
betwi-en  eyes  over  sideways  motion.  The  preferred  orientation  was  15®  clockwise  from 
vertical. 
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Figure  7.  From  Reference  #11. 


Figure  8.  From  Reference  #11. 
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Fig.  Q  Each  eye  drives  one  pool  of  motion  detectors  sensitive  to  left-right 
horizontal  motion  and  another  pool  sensitive  to  right-left  motion.  The 
outputs  of  those  four  pools  of  monocular  motion  detectors  are  routed  in  such 
a  way  that  there  are  four  pools  of  binocular  movement  detectors  sensitive 
to  movements  along  four  different  directions  in  three  dimensions.  Thus, 
the  directionally  tuned  motion  detector  OR  is  most  sensitive  to  movement 
Biong  the  direction  OR,  the  detector  IR  is  tunod  to  the  diarction  IS,  and 
so  on.  The  outputs  of  these  four  pools  of  binocular  detectors  are  compared 
at  comparators  C„  C,  and  C,  so  as  to  enhance  the  discrimination  of  direc¬ 
tion.  The  comparison  process  incidentally  produces  characteristic  maxima 
in  the  discrimination  curve  of  Fig.7  a. 

Note  that  this  Figure  covers  motion  directed  only  towards  the  subject. 
For  movements  away  from  the  subject  there  is  an  additional  set  of  four 
boxes  OR,  IR.  IL  and  OL.  For  movement  in  either  direction  the  boxes 
OR  and  IR  respond  only  when  the  left  eye’s  imago  moves  faster  than  the 
right  eye's,  while  IL  and  OL  respond  only  when  the  right  eye’s  image 
moves  faster  than  the  left  eye’s. 


Fig. 7  a,  discrimination  of  the  direction  of  movement  in  depth.  Discrimination 
is  plotted  as  ordinates,  the  directions  of  the  target's  trajectories  as  abscissae. 
Standard  deviations  are  shown  for  one  measurement  of  200  judgements; 
each  point  is  based  on  between  two  and  six  such  measurements. 

6,  sensitivity  to  movement  in  depth.  The  peak -peak  oscillations  of  disparity 
that  can  just  be  seen  are  plotted  as  ordinates  (in  min  arc)  and  the  directions 
of  the  targets’  trajectories  as  abscissae. 

e,  sensitivity  curves  of  four  hypothetical  groups  of  binocular  mechanisms 
tuned  to  different  directions  of  movement  in  depth. 
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Note  that  the  human  stereoscopic  sensitivity  to  motion  in  depth  that  we  have 
measured  is  not  predictable  from  conventional  measurements  of  positional  (static) 
depth  sensitivity. 

Changing  size  as  a  cue  to  motion  in  depth 

It  is  well  known  that  changing  size  is  a  cue  to  motion  in  depth.  We  have 

recently  shown  that,  in  man,  information  as  to  changing  size  is  processed  in  separate 
14 

channels  .  These  channels  are  quite  distinct  from  the  channels  for  sideways 
motion  (Fig.  9).  The  sensitivity,  dynamics  and  fatiguability  of  the  changing-size 
channel  differs  between  individuals,  and  does  not  seem  to  be  predictable  from  other 
visual  measurements.  On  the  basis  of  our  psychophysical  data  we  have  suggested 
that  the  changing-size  channel  corresponds  to  a  previously -unknown  and  very  specific 
neural  mechanism  in  the  visual  pathway14, 1^,1(*’1^.  Our  recent  single¬ 
neuron  evidence  is  that  such  a  physical  mechanism  does  indeed  exist  in  cat  visual 

*  18 
cortex  . 

Visual  acuity  and  visual  sensitivity  to  spatial  frequency 

There  is  good  psychophysical  evidence  that  an  image  of  the  outside  world  formed 

on  the  retina  is  split  up  into  components  of  different  spatial  frequencies  by  a 

19  20  21 

process  resembling  spatial  Fourier  analysis  *  *  .  This  analysis  is  carried  out 

by  parallel  information-processing  channels,  each  sensitive  to  a  narrow  range  of 

spatial  frequencies  of  a  particular  orientation.  Although  this  "spatial  frequency 

channel"  hypothesis  is  certainly  not  the  only  fruitful  basis  for  research  on  form 
22  23 

vision  '  ,  it  has  been  most  influential  in  drawing  attention  to  the  need  for  a 

fresh  approach  to  practical  tests  of  visual  acuity.  Since  conventional  measures  of 
visual  acuity  (e.g.,  Snellen)  test  only  the  ability  to  see  very  fine,  high-contrast 
detail,  such  conventional  procedures  examine  only  the  channels  sensitive  to  high 
spatial  frequencies  and  entirely  miss  channels  sensitive  to  medium  and  low  spatial 
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Figure  9.  Adapting  to  oscillating  size  preferentially  depressed  visual  sensitivity^ 
bcToscillating  size.  The  stimulus  was  two  identical  squares  on  either  side  of 
a  fixation  spot  (A).  Ordinates  plot  percentage  elevations  of  visual  threshold 
produced  by  25  mins  adaptation  to  2  Hz  oscillating^  size  (B)  and  2  Hz  oscillatory 
motion  (C).  Test  frequencies  are  plotted  as  abscissae.  Vertical  lines  show 
t  1  SE.  The  large  filled  star  and  large  open  star  show  threshold  elevations 
produced  by  adapting  to  2  Hz  flicker  upon  sensitivity  to  oscillating  size  and 
oscillatory  motion,  respectively.  From  Reference  if  14. 


frequencies. 

That  this  deficiency  in  conventional  testing  can  be  serious  in  practice  is 
illustrated  by  our  own  recent  findings^  and  by  those  of  Capt.  Ginsburg  (Wright- 
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Patterson  AFB) .  We  find  that  a  considerable  proportion  of  multiple  sclerosis  patients 
have  visual  defects  that  are  not  revealed  by  the  Snellen  test,  but  are  evident  to 
the  spatial -frequency  grating  test  (28/48  patients).  In  particular,  14/48  patients 
experienced  degraded  sensitivity  to  coarse  and  medium-coarse  detail  (i.e.,  low 
and  medium  spatial  frequencies)  although  sensitivity  for  fine  detail  was  unaffected 
so  that  the  Snellen  acuity  was  normal  (20/20).  Figure  10  illustrates  a  sensitivity 
loss  restricted  to  medium  spatial  frequencies. 

More  to  the  point,  our  data  for  normal  control  subjects  showed  a  considerable 
range  of  sensitivities  to  coarse  and  medium-coarse  detail,  a  variability  that  was 
not  detected  by  the  Snellen  test.  In  other  words,  visual  defects  of  patients  such 
as  those  shown  in  Fig.  10  were  only  different  in  degree  from  variations  within  the 
normal  control  group.  Therefore,  if  visual  acuity  screening  for  aircrew  were 
restricted  to  the  Snellen  type  of  test,  then  some  pilots  would  necessarily  have 
poor  low-contrast  vision  at  medium  and  low  spatial  frequencies,  and  there  would  be  no 
indication  of  this  except  possibly  in  flying  performance  under  hazy  or  low-contrast 
conditions. 

Interactions  between  different  visual  cues 

In  assessing  visual  function  it  is  usual  to  test  each  visual  parameter 

separately.  It  might  seem  reasonable  to  assume  that  a  visual  stimulus  providing 

two  cues  should  be  easier  to  see  than  a  stimulus  providing  only  one  cue,  all  other 

things  being  equal.  But  this  is  not  necessarily  true  in  practice.  For  example, 

a  moving  object  may  move  in  depth  (providing  two  cues,  namely  retinal  image 

movement)  or  may  move  in  depth  (providing  two  cues,  namely  retinal  image  movement 

and  changing  disparity).  Beverley  and  I  found  that  the  two  cues  might  add  or  might 

cancel,  so  that  depth  movement  could  be  either  easier  to  see  or  more  difficult  to 

25  26 

see  than  sideways  movement,  depending  on  the  stimulus  situation  ’ 
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Figure  JO  Illustrates  hou  multiple  sclerosis 
can  selectively  degrade  visual  sensitivity  for 
medium  spatial  frequencies.  Visual  sensitivity  to 
a  grating  (ordinates,  left  side)  plotted  versus  the 
grating's  spatial  frequency  (abscissae  in  cycles  per 
degree).  Continuous  line  for  right  eye,  dotted 
line  for  left.  Dashed  line  plots  difference  between 
visual  sensitivities  for  left  and  right  eyes  ex¬ 
pressed  as  a  ratio.  Note  that  the  two  eyes  have 
similar  sensitivities  at  high  and  low  spatial  fre¬ 
quencies.  Results  shown  for  two  patients.  Note 
that  sensitivity  increases  upwards . 


From  Reference  #24. 

In  the  real  visual  world  it  is  common  for  several  cues  to  be  present 
simultaneously,  so  that  visual  tests  should  also  look  for  interactions  between  cues 
if  they  are  to  be  effective  predictors  of  real-world  eye-limb  coordination. 
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Flow  patterns  and  changing-size  channels 


Figure  11  is  the  well-known  illustration  from  J.  J.  Gibson's  1947  Air  Force 

Report.  The  superposed  arrows  indicate  that,  as  the  pilot  moves  towards  a  point 

on  the  ground,  the  visual  scene  appears  to  flow  radially  from  that  point.  The  arrows 

indicate  that  the  rate  of  flow  increases  with  distance  from  the  point  of  impact. 

During  the  Second  World  War  J.  J.  Gibson  investigated  the  use  of  movie  displays 

as  an  aid  to  flying  training.  In  his  1947  report  he  showed  that  the  visual  flow 

pattern  is  an  important  cue  to  the  direction  of  motion,  and  is  used  by  pilots  as  a 

27 

basis  for  visual  judgements  during  landing. 


FIGURE  II  Gradients  of  Deformation  during  o  Landing  Glide 
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Gibson's  finding  could  be  taken  as  a  hint  that  the  human  visual  system  might 
contain  a  neural  organisation  that  is  sensitive  to  flow  patterns,  but  is  relatively 
insensitive  both  to  local  motion  and  to  the  local  changes  of  luminance  that  accompany 
flow  patterns  since  these  can  occur  in  the  absence  of  flow  patterns.  One  way  of 
attaining  preferential  sensitivity  to  flow  patterns  would  be  by  responding  only  to 
certain  relationships  between  local  motion  in  different  regions  of  the  visual  field. 
At  first  sight  this  seems  to  demand  interactions  across  considerable  distances  in 
the  visual  field. 

What  we  have  recently  shown  is  that  visual  sensitivity  to  flow  patterns  can  be 

28 

explained  in  simple  terms,  without  involving  such  long-range  interactions. 

We  proposed  that  a  flow  pattern  could  stimulate  our  changing-size  channel,  and 
furthermore  that  the  relative  activities  of  changing-size  channels  fed  from  adjacent 
regions  of  the  visual  tield  could  provide  a  basis  for  locating  the  focus  of  a  flow 
pattern.  This  proposal  is  illustrated  in  Figure  12.  For  simplicity  the  receptive 
field  of  a  changing-size  channel  is  shown  in  Figures  12B,  C,  D  as  a  square.  We 
suppose  that  the  flow  pattern  would  stimulate  a  changing-size  channel  sensitive  to 
expansion  (size  increase)  when  the  focus  F  fell  within  the  receptive  field  as  in 
Figures  12B  or  12C.  On  the  other  hand,  the  changing-size  filter  would  be  stimulated 
more  weakly  (or  not  at  all)  when  the  focus  F  lay  outside  its  receptive  field  (as  in 
Figure  12D).  Therefore,  a  neural  mechanism  that  compared  the  outputs  of  changing- 
size  filters  fed  from  nearby  regions  of  the  visual  field  would  provide  a  basis  for 
estimating  the  position  of  the  focus  F  rather  precisely.  The  smaller  the  dimensions 
of  the  changing-size  receptive  field,  the  more  precisely  could  the  position  of  the 


focus  F  be  estimated. 
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Figure  12  B,  C,  D  The  human  visual  system  contains  channels  sensitive  to 
changing -size.  A  changing-size  channel  will  respond  to  the  flow  pattern  when 
the  flow  pattern' 8  focus  F  falls  inside  the  channel’s  receptive  fie,ld  (represented 
by  the  square)  but  not  when  F  lies  outside  the  receptive  field.  Figure  13  presents 
evidence  that  this  could  provide  a  bssis  for  judging  the  position  of  a  flow  pattern's 
focus .  Such  judgements  would  be  precise ,  since  the  receptive  field  of  a  changing- 
size  channel  is  no  more  than  1.0 °  to  1. 5°  in  diameter. 


We  tested  this  idea  experimentally  by  finding  whether  gazing  at  a  flow  pattern 
for  some  time  preferentially  reduced  visual  sensitivity  to  changing-size,  and  if  so 
whether  this  effect  was  greater  in  the  immediate  neighbourhood  of  the  flow  pattern's 
focus  than  in  the  regions  remote  from  the  focus.*  We  measured  visual  sensitivity  to 
changing-size  by  stimulating  the  eye  with  a  test  rectangle  whose  horizontal  edges 
were  stationary  but  whose  vertical  edges  oscillated  from  side-to-side  at  1  Hz  in 
antiphase  (i.e.  moved  in  opposite  directions  at  any  given  instant;  Figure  13A). 

Control  experiments  differed  in  only  one  respect,  namely  that  the  test  rectangle's 
vertical  edges  oscillated  inphase  rather  than  in  antiphase  (i.e.  in  control  experiments 


*  We  used  the  electronically-generated  flow  pattern  illustrated  in  Figure  13B  as 
an  equivalent  of  a  realworld  flow  pattern.  In  our  simplified  flow  pattern,  however, 
the  radial  velocity  of  flow  was  constant  over  the  screen.  A  simple  calculation 
shows  that  in  a  realworld  flow  pattern  the  angular  velocity  of  flow  for  an  object 
point  located  along  a  direction  6°  from  the  point  towards  which  the  eye  is  moving 
is  proportional  to  0V/D  where  D  is  the  distance  between  the  eye  and  the  object  point 
and  V  is  the  linear  velocity  of  locomotion. 

We  plan  to  move  closer  to  the  realworld  situation  in  later  experiments  (see  below) . 
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the  edges  moved  in  the  same  direction  at  any  given  instant,  so  that  the  rectangle's 
size  remained  constant,  but  its  position  oscillated).  Subjects  adjusted  the  ampli¬ 
tude  of  the  oscillation  so  that  it  was  just  visible.  We  recorded  these  threshold 
settings  before  and  after  10-min  inspection  of  the  flow  pattern  illustrated  in 
Figure  13B.  By  calculating  the  percentage  changes  of  threshold  we  obtained  a  measure 
of  the  changes  in  visual  sensitivities  to  the  antiphase  and  inphase  test  rectangles 
caused  by  inspecting  the  flow  pattern. 

Threshold  elevations  for  the  antiphase  (changing-size)  test  rectangle  were 
plotted  as  ordinates  in  Figure  13C  versus  the  distance  X°  between  the  centre  of  the 
test  rectangle  and  the  focus  of  the  adapting  flow  pattern.  Inspecting  the  flow  pattern 
produced  clear  depressions  of  visual  sensitivity  to  the  antiphase  test  rectangle. 

But  this  adapting  effect  fell  to  insignificant  levels  when  the  centre  of  the  0.5°-wide 
test  rectangle  was  located  only  a  little  more  than  0.25°  from  the  point  in  the  visual 
field  previously  occupied  by  the  focus  of  the  adapting  flow  pattern.  Our  findings  are 
consistent  with  the  prediction  illustrated  in  Figure  12B,  C  and  D  that  threshold 
elevations  should  fall  to  zero  when  the  focus  of  the  flow  pattern  was  located  outside 
the  receptive  field  of  the  changing-size  channel  (neglecting  the  effect  of  fixation 
variations  due  to  eye  movements) ,  and  suggest  that  the  receptive  field  of  the  channel 
we  were  testing  had  approximately  the  same  width  as  the  0.5°  test  stimulus  rectangle. 
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Figure  13 

A  The  vertical  edges  of  the  test 
rectangle  oscillated  from  side-to- 
side  in  antiphase  (i.e.  test 
changing -size)  on  inphase. 
Oscillation  thresholds  were 
measured  as  a  function  of  X° 
before  and  after  10  min  inspection 
of  the  flow  pattern.  The  edges 
were  moved  by  a  triangular  waveform , 
i.e.  at  constant  speed.  Three 
test  rectangles  were  used  in 
separate  experiments .  Their  widths 
were  0.25°,  0.5 °  and  1.0 °.  All 
were  0.5 °  high.  Total  light  flux 
was  constant. 

B  Flow  pattern  of  3.5 °  diameter 
consisting  of  48  equally -spaced 
sectors,  alternate  sectors  contain¬ 
ing  13  line  segments.  The  line 
segments  flowed  radially  outwards 
from  the  focus  for  5  sec ,  then 
reversed  their  directions  of  motion 
for  5  sec ,  and  so  on.  The  flow 
pattern  and  the  test  rectangle  were 
never  visible  at  the  same  time. 
Subjects  were  allowed  10  sec 

inspection  of  the  test  rectangle  to  make  a  setting.  Sixty  sec  exposure  to  the 
adapting  flow  pattern  intervened  between  successive  postadaptation  settings  while 
60  sec  exposure  to  the  stationary  flow  pattern  intervened  between  successive  pre¬ 
adaptation  settings.  A  green  LED  of  luminance  13  cd  m~  served  as  fixation  mark  (M) . 

The  right  eye  only  was  used.  The  radial  velocity  of  flow  was  0.75  deg  sec~l,  and  was 
constant  across  the  screen. 

O  Threshold  elevations  for  the  0.5°  antiphase  test  rectangle  (ordinates)  versus 
distance  X° . 


Our  control  data  showed  that  threshold  elevations  for  inphase  oscillations  of 
the  test  rectangle's  edges  were  much  smaller  than  the  threshold  elevations  for  anti¬ 
phase  oscillations  shown  in  Figure  13C.  Furthermore,  the  inphase  elevations  did  not 
depend  upon  the  distance  X°  from  the  focus. 

Our  previous  finding  that  changing-size  channels  are  not  sensitive  to  pairs  of 
edges  more  than  about  1.5°  apart*6  make  sense  in.  the  light  of  our  present  proposal  that 
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a  major  function  of  changing-size  channels  might  be  to  provide  a  basis  for  judging 
the  location  of  a  flow  pattern's  focus,  since  changing-size  channels  sensitive  to 
narrow  objects  would  signal  the  location  of  the  focus  more  precisely  than  changing- 
size  channels  sensitive  to  wide  objects. 

Our  chief  conclusion  is  that  visual  sensitivity  to  the  location  of  a  flow 
pattern's  focus  could  be  mediated  by  channels  that  respond  to  changes  in  the  size 
of  small  objects.  The  relative  activities  of  these  changing-size  channels  might 
be  one  basis  on  which  the  brain  computes  the  direction  in  which  the  head  moves  with 
respect  to  the  external  world. 

If  visual  sensitivity  to  flow  patterns  is  important  in  landing  aircraft  and  in 
automobile  driving ,  and  if  this  visual  capacity  proves  to  be  relatively  uncorrelated 
with  the  results  of  standard  visual  tests,  then  there  may  be  flying  and  driving  tasks 
for  which  tests  of  sensitivity  to  flow  patterns  or  to  changing-size  might  profitably 
be  added  to  the  present  battery  of  screening  tests. 

Binocular  and  monocular  stimuli  for  motion  in  depth 

The  results  reported  in  this  section  bear  on  the  question  "what  effect  would  a 

sudden  loss  of  binocular  vision  have  on  visual  judgements  of  motion  in  depth".  The 

results  reported  here  are,  therefore,  relevant  to  how  a  loss  of  binocular  vision 
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might  affect  landing  performance. 

Figure  14  deals  with  the  point  that  a  sensation  of  motion  in  depth  can  be 
produced  in  two  quite  different  ways,  namely  by  stimulating  the  eye  with  changing- 
size  (0g  min  arc  sec-1)  or  with  changing-disparity  (0^  min  arc  sec-1).  Changing- 
size  stimulation  can  be‘either  monocular  or  binocular,  but  changing-disparity  can 
only  be  binocular.  The  heavy  continuous  line  and  the  heavy  dashed  line  plot  the 
amplitudes  of  changing-size  stimulation  and  changing-disparity  stimulation  that 
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Figure  14  Modulation  transfer  functions 
for  changing-size  sensation  and  motion-in¬ 
depth  sensation. 


just  produce  a  sensation  of  motion 
in  depth.  Visual  sensitivities 
are  clearly  different  atr  low 
repetition  frequencies. 

Note  also  that  a  single 
stimulus  (namely,  changing  size) 
can  produce  two  quite  different 
sensations,  namely  changing-size 
and  movement  in  depth.  The  fine 
dotted  line  plots  amplitudes  of 
changing-size  stimulation  that 
produced  a  just-detectable  sensa¬ 
tion  of  changing-size.  Comparing 
the  fine  dotted  line  with  the 
heavy  continuous  line,  it  is  clear 
that  there  is  a  large  difference 
between  sensitivity  for  the  two 
sensations  from  about  1  Hz  upwards. 

These  different  modulation 
transfer  functions  can  be  understood 


in  terms  of  the  psychophysical  model  that  we  proposed  to  explain  other  data. 

Now  we  turn  to  the  relative  effectiveness  of  changing-size  and  changing-disparity 


stimulation  as  stimuli  for  motion  in  depth  sensation.  Figures  17  and  18  show  that 
the  relative  effectiveness  is  not  constant,  but  depends  on  speed  (Figure  17)  and  on 
inspection  time  (Figure  18) . 
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Figure  15  Psychophysical  model  STEREOSCOPIC  MOTION  FILTERS  compute  the  relative 
velocities  of  the  left  and  right  retinal  images ,  and  are  thus  selectively  sensitive 
to  the  direction  of  motion  in  depth.  When  the  opposite  edges  of  a  target  move  in 
opposite  directions  UNIDIRECTIONAL  MOTION  FILTERS  drive  a  CHANGING  SIZE  FILTER  that 
produces  a  changing-size  signal  and  also  drives  a  MOTION  IN  DEPTH  STAGE  that  outputs 
a  motion-in-depth  signal.  The  stereoscopic  motion  filter  also  drives  the  motion-in- 
depth  stage. 


Figure  16  This  figure  illustrates 
the  changing-size  and  changing- 
disparity  stimulation  in  the  left 
and  right  eyes  that  is  produced  by 
a  realworld  object  moving  towards  ' 
the  head.  In  our  experiments  of 
Figures  17  and  18  we  opposed 
changing-size  and  changing-disparity 
stimulation.  In  these  experiments , 
changing-disparity  was  as  illustrated 
in  Figure  16,  but  the  size  was 
decreasing  instead  of  increasing.  y 


We  generated  a  stimulus  that  never  occurs  in  the  everyday  visual  world.  The 


stimulus  rectangle's  disparity  increased  so  as  to  indicate  that  the  square  was 
coming  closer,  but  its  size  decreased,  indicating  that  it  was  going  away  (Figure  16). 
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We  found  that  by  opposing  9g  and  0^  in  this  way  we  could  cancel  the  sensation  of 
motion  in  depth,  and  thus  measure  relative  visual  sensitivity  to  0_  and  0n.  The 
ratio  6p/6g  for  which  motion-in-depth  was  just  cancelled  we  took  as  a  measure  of 
relative  sensitivity. 

Figure  17  shows  that  the  relative  effectiveness  of  0^  and  0^  as  stimuli  for 
motion  in  depth  depended  on  speed  (i.e.  on  6g) •  The  relative  effectiveness  of 
changing-disparity  progressively  increased  as  speed  was  increased. 


TO  BE  NULLED. 
Mia  Arc/Sec. 


Figure  17  Cancellation  of  motion-in-depth 
sensation  by  opposing  changing-size  and 
changing-disparity  stimuli:  effect  of  velocity. 
The  subject  viewed  a  square y  each  of  whose 
edges  moved  outwards  at  constant  speed  for 
either  0.25  secy  1.0  sec  or  3.3  sec  as  marked 
on  the  figure.  The  square  then  disappeared 
for  0.  25  sec  and  the  cycle  repeated. 

Abscissae  plot  0^  where  0^/2  is  the  rate  of 

change  of  side  length  in  min  arc  sec~^ ) . 
Ordinates  plot  the  rate  of  change  of  binocular 
disparity  ( 6^  min  arc  sec~^)  required  to  cancel 


the  sensation  of  motion  in  depth  produced  by 
the  rate  of  change  of  size  0„.  A  -  subject  T.W. 
B  -  subject  K.B.  From  Reference  f(29. 
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In  Figure  18  we  varied  the  stimulus  inspection  time  from  0.25  sec  to  4.0  sec. 
Figure  17  shows  that  the  relative  effectiveness  of  0^  and  6g  as  stimuli  for  motion 
in  depth  depended  on  the  inspection  time.  Changing-disparity  grew  progressively 


less  effective  as  inspection  time  was  reduced. 


025  1  4 

RAMP  DURATION.  Seconds 


Figure  18  Relative  effectiveness 


a 

ramp  duration1 1  secs ,  then  disappeared 
for  0.25  sec  and  the  cycle  repealed. 
Ordinates  plot  where  0^  itt  ,‘*.2 

rate  of  change  of  disparity  required 
to  cancel  the  sensation  of  motion  in 
depth  produced  by  a  given  rate  of 
change  of  size  (8~).  Abscissae  plot 
ramp  durations.  The  numbers  by  the 
plots  indicate  the  amplitudes  of  the _ 
size  change  during  the  ramp. 

A  -  subject  T.W.  B  -  subject  K.B. 

From  Reference  if  29. 


of  changzng-dtsparity  and  changxng- 
size  as  stimuli  for  motion-in- depth 
effect  of  inspection  time. 

A  1°  x  1  square  changed size  at  a 
fixed  rate  (’Bc/2  min  arc  sec~ *)  for 
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The  data  shown  in  Figures  17  and  18  suggest  that  the  question  "what  effect 
would  a  sudden  loss  of  binocular  vision  have  on  landing  performance"  does  not  have 
a  single,  general ly-valid  answer.  A  sudden  loss  of  binocular  vision  would  remove 
the  stimulus  of  changing-disparity,  while  leaving  changing-size  as  a  stimulus  for 
motion  in  depth.  If  we  are  correct  in  our  suggestion  that  changing-size  channels 
mediate  visual  judgements  of  flow  patterns,  then  a  loss  of  binocular  vision  would 
not  have  a  great  effect  on  this  visual  function  (we  find  that  sensitivity  would 
drop  by  about  1.2-1. 4  times).  On  the  other  hand,  visual  sensitivity  to  motion  in 
depth  might  or  might  not  be  strongly  affected.  The  following  factors  would  be 
involved: 

(1)  Inspection  duration.  Motion-in-depth  sensitivity  for  short  inspection 
durations  would  be  less  affected  by  losing  binocular  vision. 

(2)  The  target's  velocity  in  depth.  Motion-in-depth  sensitivity  at  low 
velocities  would  be  less  affected  by  losing  binocular  vision. 

(3)  The  absolute  width  of  the  object.  Mot  ion- in-depth  sensitivity  for  wide 
objects  would  be  less  affected  by  losing  binocular  vision. 

(4)  The  difference  between  binocular  and  monocular  thresholds  for  motion-in¬ 
depth  sensation  produced  by  changing-size  stimulation. 

(5)  Intersubject  differences.  These  are  large.  Even  over  our  small  sample 
of  five  subjects  we  found  80:1  intersubject  differences  in  the  relative  effective¬ 
ness  of  changing-size  and  changing-disparity  as  stimuli  for  motion  in  depth. 

Summarising,  we  would  expect  that  after  a  sudden  loss  of  binocular  vision  it 
would  be  more  difficult  to  see  a  weak  flow  pattern  (sensitivity  down  by  1.2-1. 4), 


but  once  seen,  the  ability  to  locate  the  focus  would  be  little  degraded.  Therefore, 
the  only  effect  would  be  that  the  pilot  would  not  be  able  to  use  the  flow  pattern 
until  he  was  closer  to  the  landing  field.  However,  when  he  was  close  to  the  ground 
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the  result  of  losing  binocular  vision  might  be  more  serious  since  the  pilot  might 
then  require  to  judge  the  speed  of  motion  in  depth.  A  sudden  loss  of  binocular 
vision  (i.e.  the  removal  of  0^  stimulation)  could  degrade  movement-in-depth 
judgements  especially  for  small  objects  and  high  speeds,  but  this  would  depend 
very  much  on  the  individual  (see  above) . 

•  • 

The  relative  effectiveness  of  changing-size  (6^)  and  changing-disparity  (6„)  as 

w  "  '  "  1  -  *  ■  "U 

stimuli  for  motion-in-depth  does  not  depend  on  viewing  distance 

It  is  well  known  that  stereoscopic  depth  perception  is  very  insensitive  at 
distances  greater  than  about  10  metres.  In  view  of  this  it  may  seem  surprising 
that  relative  sensitivity  to  changing-disparity  (9n)  and  to  changing-size  (0-) 
does  not  depend  on  viewing  distance.  A  simplified  version  of  our  proof  is  given 
in  Figure  19. 


s 

«« 


Figure  Iff  A  stimulus  correlate 
of  an  object's  absolute  linear  width. 

Approximately  0D  =  9*  = 

es  =  I and  es =  wm-  Eence 

(0^-eD)  =  A6d  =  and  (65-65)  - 

A6_  =  y£r-.  Thus  =  y-.  Hence 
o  u  1 

0s/9d  =  T*  W0V^8:  utdth  of  object 

(S)  =  I  x  (Rate  of  change  of  angular 
width  i  (Rate  of  change  of  angular 
disparity) .  Rote  that  this  gives 
the  object  ra  width  independently  of 
its  distance,  and  that  the  visual 
system  contains  channels  for  0^  and 

bp  so  that  the  absolute  value  of  S 

is,  in  principle,  available  to  the 
visual  system.  From  Reference  # 29 • 


Practical  calculations  of  the  relative  effectiveness  of  binocular  and  monocular 
cues  for  mot  ion- in-depth 

The  experimental  measurements  of  Figure  18  and  the  theory  of  Figure  19  allow 
us  to  calculate  the  relative  effectiveness  of  binocular  and  monocular  cues  to 
motion  in  depth  in  practical  cases.  For  example,  we  can  predict  the  effect  of 
closing  one  eye  upon  motion-in-depth  perception  when  travelling  at  a  given  velocity 
at  a  given  distance  from  the  landing  point. 

In  order  to  illustrate  the  extent  to  which  the  relative  effectiveness  of 
changing-disparity  and  changing-size  as  stimuli  for  motion-in-depth  depends  on  the 
stimulus  situation  I  have  calculated  three  real-world  examples,  choosing  extreme 

visual  conditions.  (These  calculations  are  by  way  of  illustration  only.)  The 

•  • 

method  of  calculation  is  set  out  below  in  single  spacing,  and  the  values  of  6p/e«i 
for  subject  T.W.  in  Figure  18  were  used.  Example  #1  is  an  airplane  travelling  at 

140  mph,  2000  ft  from  a  runway  100  ft  wide.  If  the  pilot  (subject  T.W.)  looked  at 

•  ■ 

the  runway  for  1.0  sec,  0D/®g  would  equal  0.16,  so  that  allowing  for  geometric 
factors  (Figure  19) ,  changing-size  would  be  76  times  more  effective  than  changing- 
disparity  as  a  stimulus  for  mot ion- in- depth. 

Example  #2  is  a  cricket  ball  2.5"  in  diameter  50  ft  from  the  head  and  approach¬ 
ing  at  90  mph.  If  subject  T.W.  inspected  this  rapidly-moving  object  for  0.25  sec, 

•  • 

then  from  Figure  18,  eD/es  would  equal  0.47.  Allowing  for  geometric  factors 

(Figure  19),  changing-disparity  would  be  2.1  times  more  effective  than  changing- 

disparity  as  a  stimulus  for  movement -in- depth.  Example  #3  is  a  fly  0.2  cm  wide 

moving  at  5  cm  sec-1  directly  towards  the  head  and  located  50  cm  from  the  head. 

•  • 

If  subject  T.W.  inspected  the  fly  for  1.0  sec,  then  from  Figure  18,  eD/®s  would 
equal  0.44.  Allowing  for  geometric  factors  (Figure  19)  changing-disparity  would 
be  72  times  more  effective  as  a  stimulus  for  movement  in  depth. 
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Method  of  calculation 


At  2000  ft  the  angular  width  of  the  runway  is  2.72°.  After  1  sec  approaching 
at  140  mph,  the  angular  width  increases  to  3.02°.  Hence  the  mean  rate  of  change 
of  angular  width  0  =  0.295°/sec  =  17.7  min  arc/sec  (i.e.  8.86  min  arc/sec  for 
each  edge) . 

•  • 

For  subject  T.W.  the  rate  of  change  of  disparity  (0p)  equivalent  to 0  g  =  17.7 
min  arc/sec,  for  an  inspection  time  of  1,0  sec  is  0^  =  174  min  arc/sec.  (From  Fig.  18) 

Hence  ®D/®S  =  0.16. 

.  .  From  the  geometrical  considerations  outlined  in  Figure  19  we  would  expect  that 

0D/0S  *  I/S.  In  ,thi,s  case  S  =  100  ft  and  I  =  2.5  inches,  as  the  geometrically 
predicted  ratio  ®D/es  is  0.0021. 

Hence,  allowing  for  geometric  factors,  changing-size  would  be  76  times  more 
effective  than  changing-disparity  as  a  stimulus  for  motion-in-depth,  for  subject  T.W. 


Example  #2  Cricket  Ball 


At  50  ft  the  angular  width  of  the  cricket  ball  is  10.8  min  arc.  After  0.25  sec 
approaching  at  90  mph,  the  angulqr  width  increases  to  21.2  min  arc.  Hence  the  mean 
rate  of  change  of  angular  width  0S  =  42.4  min  arc/sec  (i.e.  21.2  min  arc/sec  for 
each  edge) . 

For  subject  T.W.  and  for .an  inspection  time  of  0.25  sec  the  rate  of  change  of 
disparity  (0n)  equivalent  to  0_  =  42.4  min  arc/sec  is  L  *  10  min  arc/sec. 

(From  Figure  18.) 

Hence  0p/0g  =  0.47. 

From  the  geometrical  considerations  outlined  in  Figure  19  we  would  expect 
0p/0g  =  I/S.  In  this  case  S  =  2.5  inches  and  I  =  2.5  inches,  so  the  geometrically- 
expected  ratio  0D/0g  is  1.0. 

Hence,  allowing  for  geometric  factors,  changing-disparity  would  be  2.1  times 
more  effective  than  changing-size  as  a  stimulus  for  motion-in-depth  for  subject  T.W. 


Example  #3 


At  50  cm  the  angular  width  of  the  fly  is  13.1  min  arc.  After  approaching  at 
5  cm/sec  for  1.0  sec,  the  angular  width  increases  to  14.5  min  arc.  Hence  the  mean 
rate  of  change  of  angular  width  0g  =  1.37  min  arc/sec  (i.e.  0.68  min  arc/sec  for 
each  edge) . 

For  subject  T.W.  and  for .an  inspection  time  of  1.0  sec  the  rate  of  change  of 
disparity  (0n)  equivalent  to  0<,  is  equal  to  1.37  min  arc/sec  is  6n  =  0.3  min  arc/sec. 
(From  Figure  18.) 

Hence  0D/0S  =  0.44. 

.  .  From  the  geometrical  considerations  outlined  in  Figure  19  we  would  expect 

0p/0g  =  I/S.  Ig  t)jis  case  S  «  0.2  cm  and  I  =  6.5  ems  as  the  geometrically- 
expected  ratio  0D/0S  is  equal  to  31.8. 

Hence,  allowing  for  geometric  factors,  changing-disparity  would  be  72  times 
more  effective  than  changing- size  as  a  stimulus  for  mot ion- in-depth  for  subject  T.W. 


Figure  20 

A 


In  the  experiments  described  up  to  this  point,  we  have 
shown  that  the  human  visual  system  contains  a  channel  for 


pure  antiphase  oscillations  (i.e.  pure  z-direction  motion, 
see  Fig.  20A) .  These  experiments  were  restricted,  however, 
since  we  used  only  pure  antiphase  and  pure  inphase  stimuli 
(i.e.  pure  z-direction  and  pure  x-direction  motion).  In  the 
real  world,  of  course,  motion  can  occur  along  trajectories 
other  than  those  along  the  z-  and  x-directions .  We  therefore 


carried  out  experiments  to  find:  (a)  whether  the  visual  pathway 
precisely  computes  the  x-direction  component  of  motion  (V^) 
for  any  arbitrary  trajectory;  (b)  whether  the  visual  pathway  precisely  computes 
the  z-direction  component  of  motion  (V2)  for  any  arbitrary  trajectory. 

The  rationale  of  Experiment  #1  is  set  out  in  Figure  20B 
where  7  different  oscillation  trajectories  are  shown.  Each  of 
these  trajectories  had  the  same  x-axis  component  V^.  On 
separate  days  subjects  adapted  to  each  of  these  trajectories 
and  we  measured  threshold  elevations  for  pure  x-direction  and 
for  pure  z-direction  test  stimuli.  If  the  visual  pathway 
contained  a  channel  for  Vx  that  was  independent  of  the  value 
of  V2>  then  all  7  trajectories  should  give  the  same  threshold 
elevation  for  the  pure  x-direction  (inphase)  test  stimulus. 

We  found  that  this  was  not  true.  Inphase  threshold  elevations 


collapsed  when  even  a  small  amount  of  z-axis  motion  was  present  (Fig.  21). 
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Figure  2 
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Figure  22 


The  rationale  of  Experiment  #2  is  set  out  in  Figure  20C  where  7  different 

trajectories  are  shown.  Each  of  these  trajectories  had  the  same  z-axis  component 

of  motion  (V  ) .  On  separate  days  subjects  adapted  to  these 
Figure  20  z 

trajectories,  and  we  measured  threshold  elevations  for  z- 
direction  (pure  antiphase)  and  for  x-direction  (pure  inphase) 
motion.  If  the  changing-size  channel  does  indeed  compute 
z-direction  motion  (V^)  accurately  for  any  trajectory,  then 
all  the  different  trajectories  should  give  the  same  threshold 
elevations  for  the  antiphase  test  oscillation.  Figure  22k 
shows  that  was  approximately  the  case.  Threshold  elevations 
for  the  z-direction  test  stimulus  were  constant  to  within  30% 
even  when  x-direction  oscillation  of  up  to  8  times  the  ampli¬ 
tude  of  the  z-direction  motion  was  added  to  the  adapting  stimulus. 


We  conclude  that  the  changing-size  channel  is  independent  of  trajectory  and 
acts  as  though  it  computes  the  algebraic  difference  between  the  velocities  of  an 
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object's  opposite  edges  (i.e.  when  the  edges  move  in  opposite  directions  it  adds 
the  speeds,  and  when  the  edges  move  in  the  same  direction  it  subtracts  the  speeds). 

We  noted  that  departure  from  Constance  was  greatest  for  trajectories  where 
two  of  the  stimulus  rectangle's  sides  were  stationary.  This  suggested  that  the 
changing-size  channel's  30%  departure  from  accuracy  might  be  a  form  of  "crossover 
distortion".  In  which  case,  just  as  a  high-frequency  oscillation  linearizes  the 
crossover  distortion  in  a  magnetic  tape  recorder,  an  auxiliary  linearizing  oscil¬ 
lation  might  linearize  the  performance  of  the  human  visual  system.  We  therefore 
repeated  Experiment  #2,  but  this  time  with  a  high-frequency  (8  Hz)  triangular  wave 
linearizing  oscillation  added  to  the  2-Hz  adapting  oscillation  as  illustrated  in 
Figure  23.  Figure  22 B  shows  that  indeed  the  effect  of  the  added  8-Hz  oscillation 
was  to  abolish  the  30%  inaccuracy  of  the  changing-size  channel.  In  Figure  22B 
the  changing-size  channel  computes  the  Vz  component  of  motion  to  a  remarkable 
accuracy  of  5%  for  all  trajectories  tested.  We  note  that  the  presence  of  linear¬ 
izing  oscillation  can  be  regarded  as  typical  of  real-world  viewing  conditions  (i.e. 
added  "jitter"  or  vibration).  The  data  of  Figure  22A  are  replotted  in  polar 
coordinates  in  Figure  24  and  the  data  of  Figure  22B  are  replotted  in  Figure  25. 


Figure  23 

Oscillations  of  the 
edges  of  the  stimulus  for 
two  trajectories  "A"  and 
"B".  The  trajectory  "A" 
is  directed  along  a  line 
straight  at  the  eye. 

For  trajectory  "B"  one 
edge  only  just  hits  the  eye. 
The  rightmost  squares  show 
the  2-Hz  oscillation  with 
added  8-H z  linearizing 
oscillation. 
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Our  finding  implies  that  a  small  degree  of  "jitter  oscillation"  due,  for 
example,  to  vibrations  of  the  head  or  body  considerably  improves  the  performance 
of  the  human  changing- size  channel,  and  thus  presumably  improves  the  accuracy  of 
motion- in-depth  judgements. 


WITHOUT  LINEARIZING  OSCILLATION 


WITH  LINEARIZING  OSCILLATION 


Figure  24 

Dotted  line  shows  sensitivity 
of  z-direction  motion  channel  for 
different  trajectories.  Without 
lineari zation. 


Figure  25 

Dotted  line  shows  sensitivity 
of  z-direction  motion  channel 
for  different  trajectories . 

(With  linearizing  vibration  or 
"jitter".) 
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Dynamics  of  the  changing-size  channel 

In  order  to  understand  how  eye- limb  coordination  is  limited  in  its  dynamic 
performance  it  is  necessary  to  measure  the  dynamic  properties  of  each  of  the 
several  visual  channels  involved  in  eye-limb  coordination.  Therefore  we  have 
investigated  the  temporal  frequency  response  of  the  changing-size  channel.  In 
these  experiments  subjects  adapted  to  a  changing-size  square  of  side  length  0.5° 
whose  size  oscillated  at  F  Hz,  each  size  moving  through  6  min  arc  pk-pk.  Threshold 
for  inphase  and  antiphase  oscillations  were  measured  before  and  adaptation  for 
test  frequencies  of  0.25,  0.5,  1.0,  2.0,  4.0,  8.0,  12.0,  16.0  and  24  Hz.  This 
experiment  was  repeated  for  adapting  frequencies  of  0.25,  0.5,  1.0,  2.0.  4.0,  8.0, 
12.0  and  16.0  Hz.  A  total  of  13  subjects  were  tested  who  worked  92  hours  in  total. 

Figure  26  collapses  data  across  all  subjects.  Percentage  threshold  elevation 
versus  stimulus  test  frequency  is  plotted  for  each  adapting  frequency.  We  tenta¬ 
tively  split  the  data  into  two  frequency  regions,  namely  0.5-8. 0  Hz  and  8.0-16  Hz. 
Threshold  elevations  show  clear  temporal  tuning  in  both  frequency  ranges.  Clearly 
there  is  a  plurality  of  frequency-selective  subsystems:  it  is  not  the  case  that  all 
changing-size  channels  have  the  same  frequency  selectivity.  Between  0.5  and  8.0  Hz 
there  are  at  least  three  and  possibly  a  continuum  of  different  frequency  selectivi- 
ties.  Above  8.0  Hz  there  seems  to  be  one  sharply- tuned  subsystem,  peaking  at  16  Hz. 
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Progress  October  I,  1981  -  September  30,  1982 
Aims  1,  2,  3:  Can  subjects  use  flow  pattern  information  to  guide  self-motion  in 


the  presence  of  retinal  image  translation  caused  by  eye  rotation  and  vehicular 


mot i on i 


Gibson  suggested  that  subjects  can  use  the  expanding  visual  flow  pattern 
to  guide  self-motion.  Figure  27  illustrates  the  point  that  translational 
motion  of  the  retinal  image  can  distort  the  flow  pattern  to  the  extent  of 
shifting  or  even  abolishing  the  focus.  Although  Gibson  discussed  flow 

patterns,  not  on  the  retinal  image,  but  in  a  theoretical  construct  (the  "optic 
array")  the  central  practical  question  remains:  can  subjects  in  practice  use 
the  flow  pattern  to  guide  self-motion  in  the  presence  of  translational  motion 
of  the  retinal  image?  Such  translational  motion  would  occur  whenever  the  subject 
fixates  a  point  in  the  external  world  other  than  the  (presumably  unknown) 
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destination  and  also  when  the  vehicle  (e.g.  aircraft  or  helicopter)  yaws, 
pitches  or  sideslips.  Gibson  also  pointed  out  and  discussed  extensively  that 
when  an  observer  moves  through  the  external  world  the  image  in  the  optic  array 
is  geometrically  distorted,  and  suggested  that  this  distortion  is  an  aid  to 
judging  self-motion.  It  seems,  however,  that  he  did  not  explicitly  distinguish 
between  the  effectiveness  and  reliability  of  expanding  flow  pattern  and  geometri¬ 
cal  distortion  as  aids  to  judging  self-motion.  In  particular,  we  note  that 
translational  motion  has  comparatively  little  effect  on  distortion  in  the  retinal 
image.  The  equipment  described  below  was  designed  to  isolate  and  separately 
study  the  expanding  flow  pattern  and  geometrical  distortion  as  aids  to  judging 
self-motion. 

We  developed  a  computer  program  to  display  on  a  CRT  screen  a  dynamic  image 

that  mimicked  the  retinal  image  seen  by  an  observer  moving  forwards  towards  a 
34 

vertical  plane.  In  particular,  the  following  parameters  were  included: 

(a)  variable  expanding  flow  pattern;  (b)  variable  translational  velocity; 

(c)  variable  geometrical  distortion;  (d)  external  object  of  variable  location; 

(e)  fixation  mark  to  define  the  location  of  the  observer's  fovea. 

Our  findings  were  as  follows:  (1)  Subjects  cannot  judge  the  centre  of  an 

expanding  flow  pattern  in  the  presence  of  translational  motion  when  there  is 

34 

no  accompanying  geometrical  distortion.  This  finding  agrees  with  a  previous 

33 

report  in  a  rather  different  experimental  situation;  (2)  Subjects  are  very 


sensitive  to  geometrical  distortion  of  the  retinal  image,  and  can  accurately 

judge  the  location  of  the  maximum  rate  of  object  magnification  even  in  the 

presence  of  translational  motion  (Figs  285  29).  The  relevance  of  this  finding  : 

to  aviation  is  that  in  some* (but  not  all)  visual  environments  the  maximum  l 

rate  of  change  of  magnification  approximates  the  observer's  destination. 

I 

To  give  an  impression  of  the  dynamics,  we  can  say  that  our  experimental  condi¬ 
tions  approximated  the  view  from  an  automobile  travelling  at  30  mph  directly 
at  a  wall  80  yards  away.  | 

i 

j 

| 

i 


*  For  example,  an  observer  travelling  at  right  angles  to  a  flat  plane  as  in 
a  steep  dive. 
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Direction  of  |«it  relativo  to  direction 
of  simulated  self  motion  (dagrtas) 


L«d  Ruht  •  ° /a  o 

Distance  across  screen  (degrees^  ^ 

Fig.  28  above).  Three  of  fhe  expanding  flow  •  Jy°  y  <LL 

patterns  used  in  this  study.  The  instantaneous  %  0  9  , 

velocity  at  any  point  in  the  pattern  was  first  s  ,  ^  *  *  *  -» 

made  a  power  function  of  distance  across  the  £  ^o.a 

pattern.  Then  a  uniform  translational  speed  •  3  '  |  _ 4 

was  added  to  render  stationary  the  pattern  at  w  t - I - I  f  l0 

the  center  of  the  screen  (the  point  of  gaze).  2  l0,  '  I 

Solid  line,  expansion  pattern  for  which  the  s  wwT  .  .  . 

rate  of  change  of  magnification  was  uniform  |  -a  -2  o  2  < 

across  the  pattern  (n  =  1 .0).  Dashed  line,  rate  ’  Dl,,cll0n  of  roiot.vo  to  a.roctioii 

of  change  of  magnification  was  slightly  great-  °  of  tunuiotod  toff  motion  (dotioool 

cr  at  one  point  in  the  pattern  (arrow)  than  e  r 

elsewhere  (n  =  0.5).  Dotted  line,  rate  of  “  _ 

change  of  magnification  was  considerably  *  0  09  \.  •* 

greater  at  the  arrow  than  elsewhere  (n  =  0.3).  „  \ 

In  different  stimulus  presentations  the  point  of  2 

maximum  rate  of  magnification  occurred  at  ”  09 

the  center  of  the  screen  or  at  various  dis-  ~ 

tances  to  left  and  right  of  center,  but  the  °  1 

pattern  at  the  center  of  the  screen  was  always  S’  }  .  \ 

stationary.  Fig^f  (right).  (A  and  B)  Sub-  ;  \. 

jects  were  not  able  to  disentangle  the  direc-  2  10  r 

tion  of  gaze  from  the  direction  of  self  motion  „„  or 

when  the  rate  of  change  of  spatial  frequency  '  ’  '  '  '  '  °* 

was  uniform  over  the  pattern  (n  =  1.0)  and  o.oj  q 

could  hardly  perform  the  task  for  n  =  0.9.  but  ^ 

when  the  rate  of  change  of  magnification  was  o.i 

appreciably  greater  along  the  direction  of  sim- 

ulated  self  motion,  subjects  were  able  to  judge  rs, 

the  direction  of  simulated  self  motion  almost  i  \ 

independently  of  the  direction  of  gaze  \ 

(n  =  0.8,  n  =  0.7).  For  n  =  0.5  and  n  -  0.3,  1 

subjects  wer*  somewhat  more  accurate  when  ~ 

looking  approximately  along  the  direction  of  ,0; . 

simulated  self  motion.  The  rate  of  expansion  .* _ . 

in  all  cases  was  equivalent  to  impact  with  the  o.3  o.s  0.7  o.» 

target  5  seconds  after  onset  of  stimulation.  i.i 

Initial  spatial  frequency.  5  cycle/deg.  Field 

size,  16°  vertical  by  20°  horizontal;  mean  luminance.  30  cd/m:;  and  viewing  was  monocular.  (C 
and  D)  Accuracy  measured  with  subjects  looking  approximately  along  the  direction  of  motion. 


ares  28  and  29 


Eiponint  (n) 
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Aims  1,  2:  Texture  changes  versus  size  changes  as  stimuli  for  motion  in  depth 

Many  real-world  objects  that  have  a  definite  boundary  also  have  a  visible 

surface  texture.  The  retinal  image  of  such  an  object  continuously  undergoes 

two  types  of  change  as  it  approaches;  the  image  size  grows  larger  and  the 

surface  texture  grows  coarser.  We  compared  these  two  visual  changes  in  terms 

of  their  effectiveness  as  stimuli  for  the  sensation  of  motion  in  depth.  We 

attempted  to  dissociate  their  contributions  to  the  sensation  of  motion  in  depth 

35 

by  pitting  one  against  the  other.  For  this  purpose  we  developed  special- 
purpose  electronics  controlled  by  computer  that  can  display  the  textured 
patterns  on  a  CRT.  Figure  30  illustrates  several  combinations  of  texture 
change  and  size  change. 

We  used  the  strength  of  the  motion  in  depth  aftereffect  as  an  index  of 
the  effectiveness  of  any  stimulus.  The  motion  in  depth  aftereffect  was  measured 
in  exactly  the  same  way  for  all  the  different  stimuli,  namely  by  cancelling 
the  aftereffect  using  a  blank  square  as  test  stimulus. 

We  found  that  changing  the  size  of  an  untextured  object  is  an  effective 
stimulus  for  motion  in  depth,  as  indicated  by  the  stars  at  zero  on  the  abscissae 
in  Figure  31.  This  effectiveness  was  strikingly  reduced  by  the  presence  of 
static  texture.  Figure  32  shows  how  progressively  raising  the  contrast  of 
static  texture  from  zero  progressively  reduced  the  strength  of  the  motion  in 
depth  aftereffect  almost  to  zero. 

Changing  texture  alone  with  constant  square  size  was  a  fairly  effective 
stimulus  for  motion  in  depth  as  indicated  by  the  dashed  lines  in  Figure  31, 
whereas  changing  stimulus  object  size  with  static  texture  is  comparatively 
ineffective  (intersection  of  the  continuous  line  plots  with  the  ordinates). 
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RATE  OF  CHANOE  OF  TEXTURE  ELEMENT 
SIZE  min.  arc  sec  '1 


_  Moticm-in-depth  produced,  by  texture  alone,  by  size ,  and  b 

texture  plus  size.  A  motion-in-depth  aftereffect  was  produced  by 
inspecting  a  textured  square  of  1.2 0  mean  side  length  that  contracted 
with  a  ramping  waveform.  The  adapting  square  's  texture  contracted  at 
different  rates  (illustrated  in  Figure  30A ,  B  and  plotted  as  positive 
abscissae)  or  expanded  at  different  rates  (illustrated  in  Figure  30V 
and  plotted  as  negative  abscissae) .  Ordinates  plot  the  rate  of  change 
of  the  test  square 's  side  length  required  to  just  cancel  the  motion- 
in-depth  aftereffect  (continuous  lines).  The  test  square  was  always 
untextured.  Filled  diamonds  (dashed  lines)  plot  the  strengths  of 
aftereffects  produced  by  inspecting  a  textured  square  whose  side 
length  was  a  constant  1.2° ,  but  whose  texture  element  size  expanded 
or  contracted  at  different  rates  (e.g.  Figure  30E).  Dashed  lines 
plot  the  strength  of  this  aftereffect.  The  stars  at  zero  on  the 
abscissa  show  the  strength  of  the  motion-in-depth  aftereffect  produced 
by  inspecting  the  untextured  adapting  square  shown  in  Figure  30F.  The 
vertical  extent  of  the  horizontal  shaded  area  indicates  ±1  SE.  Vertical 
lines  show  tl  SE.  Where  absent  they  were  smaller  than  the  symbol. 

Each  point  is  the  mean  of  10  settings. 
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TEXTURE  CONTRAST  % 


.  Effect  of  texture  contrast  on  the  motion-in-depth  aftereffect. 
The  rate  of  change  of  the  teat  square's  side  length  required  to  just 
cancel  the  motion-in-depth  aftereffect  (ordinates)  was  measured  as  a 
function  of  the  " texture  contrast"  of  the  adapting  square  (abscissa) . 

The  test  square  was  always  untextured.  The  curve  was  measured  for  a 
mean  square  contrast  of  200 %  (open  squares)  and  for  100 %  (open  diamonds) , 
50%  (open  triangles) ,  25%  (filled  diamonds ) ,  and  12.5 %  (filled  squares). 
All  the  data  points  were  taken  into  account  in  deriving  a  single  curve. 
This  single  curve  was  bodily  shifted  along  the  logarithmic  ordinate  to 
give  the  best  (least  square)  fits  shown.  Vertical  lines  show  tl  SE. 

Where  absent  they  were  smaller  than  the  symbol.  Each  point  is  the  mean 
of  10  settings.  ” Texture  contrast"  was  defined  equal  to  100(c/a)%. 

" Square  contrast"  was  defined  equal  to  100(a/b)%.  A  and  B  show  data 
for  subjects  KB  and  DR  respectively . 
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What  is  the  relative  effectiveness  of  these  two  stimuli  for  motion  in  depth 
when  both  are  present  simultaneously?  The  continuous  line  in  Figure  31 
plots  the  strength  of  the  motion-in-depth  aftereffect  when  both  stimuli  were 
present,  sometimes  acting  in  conjunction  (positive  abscissae),  and  at  other 
times  being  pitted  against  one  another  (negative  abscissae). 

With  the  aim  of  dissociating  the  parts  played  by  texture  changes  and 
by  expansion  of  object  size  as  stimuli  for  motion  in  depth  we  write 

d  _  (magnitude  of  measured  aftereffect)  -  (magnitude  of  predicted  aftereffect) 
(magnitude  of  measured  aftereffect)  +  (magnitude  of  predicted  aftereffect) 

1AS»t]  ~  1AS'I'AtI 
lAsvr|  +  Ias  +  atI 

where  d  is  the  summation  ratio,  As+p  is  the  strength  of  the  aftereffect  when 
both  square  size  and  texture  element  size  change,  Ag  is  the  strength  of  the 
aftereffect  when  only  square  size  changes,  texture  element  size  being  constant, 
and  Ap  is  the  strength  of  the  aftereffect  when  only  texture  element  size  changes, 
square  size  being  constant.  Values  of  d  calculated  from  the  Figure  31  data 
plotted  in  Figure  33.  Figure  33  shows  that,  in  almost  all  cases,  the  aftereffect 
produced  by  simultaneous  changes  of  size  and  texture  was  not  simply  the  sum  of 
the  separate  aftereffects  produced  by  size  change  alone  and  by  texture  change 
alone.  In  other  words  d  was  not  equal  to  zero  in  most  stimulus  conditions. 

Figure  33  shows  that  when  square  size  and  texture  element  size  both  contracted, 
the  departure  from  linear  summation  was  in  the  direction  of  enhanced  motion-in¬ 
depth  aftereffect  (d  > 0) .  This  enhancement  could  be  so  large  that  the  recorded 
aftereffect  (Ag+p)  was  6.6  times  greater  than  (Ag  +  Ap)  ,  the  sum  of  the  two 
separate  contributions  (subject  KB  at  +1  on  the  abscissa).  However,  when  square 


’  1 1 
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size  contracted  while  texture  element  size  expanded,  the  deparutre  from  linear 
summation  was  in  the  direction  of  reduced  aftereffect  (d <  0) .  This  mutual 
inhibition  could  be  so  great  that  no  aftereffect  (Ag+y)  at  all  could  be 
recorded  (-1  and  -2  on  abscissa  for  both  subjects),  even  though  the  linearly- 
predicted  aftereffect  (Ag + A^O  was  large.  The  striking  influence  of  this 
interaction  between  texture  and  size  contributions  is  illustrated  by  noting 
that,  for  subject  KB,  the  sum  of  the  two  contributions  (Ag + A^)  was  rather 
larger  at  -2  on  the  abscissa  (Ag  +  A^,  =  11.5)  than  at  +4  on  the  abscissa 
(Ag  +  A^,=  7.3),  yet  no  aftereffect  at  all  was  recorded  in  the  first  case 
(Ag+T = 0)  while  the  second  condition  produced  the  strongest  recorded  aftereffect. 

Due  to  current  limitations  in  computer-generated  imagery  (CGI)  techniques, 
almost  all  commercially  available  flight  simulators  represent  the  visual  world 
in  a  cartoon-like  fashion  so  that  an  object's  limiting  boundary  is  shown,  but 
surface  texture  is  almost  or  completely  absent.  However,  there  are  CGI  simulator 
displays  under  development  that  include  some  texture  and  shading.  Our  emphasis 
here  on  dynamic  features  of  vision  departs  somewhat  from  the  emphasis  on  static 
picture  quality  (e.g.  as  would  be  seen  in  a  still  photograph  of  one  TV  frame) 
that  has  traditionally  been  the  chief  criterion  of  quality  in  simulator  displays. 
Here  we  report  evidence  that  texture  dynamics  are  important  in  mot ion- in-depth 
perception,  since  strong  interactions  can  occur  between  visual  responses  to 
changing  texture  and  to  changing  size.  In  terms  of  the  monocular,  two-dimensional 
simulation  of  motion  in  depth,  our  findings  suggest  that  in  most  conditions  the 
presence  of  texture  reduces  stimulus  effectiveness,  and  at  best  the  presence 
of  texture  adds  little  to  the  effectiveness  of  an  untextured  stimulus  (Figure  32). 
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Aims  1,  2:  Brain  neurons  that  may  underlie  the  motion- in-dcpth  channels  in  man 

We  have  found  single-neuron  evidence  to  support  our  proposal  that  the 

visual  pathway  has  separate  stereoscopic  subsystems  tuned  to  relative  position 

in  depth  and  to  the  direction  of  motion  in  depth.  We  used  extracellular  micro- 

electrodes  to  record  from  single  neurons  in  the  visual  cortex  of  anaesthetized 
36  37 

cat.  *  Figure  34A  shows  a  class  of  binocular  neuron  that  is  so  sharply  tuned 

to  the  direction  of  motion  in  depth  that  it  responds  to  a  range  of  directions  in 

depth  spanning  only  1°  to  2°.  The  neuron  of  Figure  34A  accurately  maintained 

36 

its  tuning  over  a  fourfold  range  of  speeds.  Some  of  these  neurons  are 
comparatively  unaffected  by  disparity  over  a  disparity  range  of  several  degrees. ^ 
These  neurons  are  very  sensitive  to  motion  in  depth  while  being  little  affected 
by  position  in  depth.  Figure  34B  shows  a  different  type  of  neuron  that  responds 
only  over  a  narrow  range  of  disparities.  This  type  of  "binocular  depth"  neuron 
was  well  known  previously.  Figure  34B,  however,  adds  the  finding  that  this  depth 
neuron  is  also  tuned  to  the  direction  of  motion  in  depth,  since  it  fires 
strongly  only  for  motion  in  the  frontal  plane. 

Aims  1-3:  Theoretical  and  practical  development  of  the  channel  theory  and  its 
relevance  to  aviation 

The  channel  hypothesis  reviewed  in  "Background"  above  has  been  developed 

38 

more  extensively  in  an  article  for  Psychological  Review,  and  the  implications 

for  skilled  eye-limb  coordination  are  surveyed  in  an  invited  Festschrift  for 

39 


Professor  I.  Kbhler. 
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Figure  34A 


Figure  Z4B 


Spikes  recorded  from  single  neurons  in  cat  visual  cortex 
(plotted  radially)  as  a  function  of  the  direction  of 
motion  in  depth  (plotted  as  azimuthal  angle). 

A  -  This  unit  maintains  its  very  selective  tuning  to  the 
direction  of  motion  in  depth  over  a  4:1  speed  range. 

Note  that  firing  is  almost  restricted  to  a  range  of 
directions  little  wider  than  1° .  This  directional 
tuning  is  achieved  by  interocular  inhibition  as  shown  by 
the  arrows. 

B  -  This  unit  fired  appreciably  only  when  the  target 
moved  closely  parallel  to  the  frontoparallel  plane  in  a 
left-right  direction  and  when  vision  was  binocular. 
Closed  circles  show  firing  when  the  two  eyes  were  stimu¬ 
lated  separately  and  open  circles  show  firing  when 
binocular  vision  was  used.  The  dotted  area  indicates 
the  very  strong  interocular  facilitation  observed  for 
binocular  vision. 
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Aims  4,  6,  7:  Correlations  between  visual  test  results  and  flying  performance 
on  the  Advanced  Simulator  for  Pilot  Training  (ASPT) 

This  work  was  carried  out  at  Williams  AFB  in  two  visits.  It  was  a  joint 
effort  by  Mr.  R.  Kruk  (who  conducted  the  measurements  at  Williams  AFB),  Dr.  T. 
longridge  of  Williams  AFB/HRL,  Dr.  K.  I.  Beverley  (Dalhousie)  and  Dr.  D.  Regan 
(P.I.).  This  work  could  not  have  been  carried  out  without  the  expert  aid  and 
advice  of  the  staff  of  HRL,  Williams  AFB  and  the  expert  aid  and  cooperation  of 
student  pilots  and  pilot  instructors  (82nd,  96th  and  97th  FTS,  Williams  AFB), 
fighter  pilots  (429  TFS  and  474  TFW,  Nellis  AFB,  62  TFTS  and  56  TTS,  MacDill 
AFB  and  weapons  systems  officers  (58  TTS,  Luke  AFB) . 

First  visit  to  Williams  AFB 

The  aim  of  this  visit  was  to  correlate  visual  psychophysical  and  visual 
tracking  test  results  both  with  simulator  flying  performance  and  with  flying 
grades  in  aircraft.  A  battery  of  13  test  results  was  successfully  obtained 
from  each  subject  tested.  The  simulator  tests  chosen  were  low-visibility  landing 
(ASPT  simulator)  and  formation  flying  (formation  simulator).  Unfortunately, 
the  formation  simulator  broke  down,  so  we  were  restricted  to  landing  data. 

A  multiple-staircase  tracking  method  was  used  to  obtain  psychophysical 
data.  Although  this  does  not  separate  criterion  from  sensitivity  as  well  as 
ROC  methods,  it  is  more  satisfactory  them  the  method  of  adjustment,  and  much 
faster  than  ROC  methods.  Tracking  data  for  changing-size  (motion  in  depth) 
perturbed  changing-size  (to  reveal  "crosstalk"  between  channels)  and  sideways 
motion  were  obtained  using  our  device  described  elsewhere  (Ref.  40  and  the 
previous  AFOSR  report.  This  device  has  been  patented  by  the  Air  Force.) 

The  psychophysical  tests  are  listed  in  Table  1.  Each  of  the  five  groups  tested 
comprised  12  members  as  follows: 
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Group  1  -  Air  Force  primary  student  jet  pilots  training  on  the  T37  aircraft; 

Group  2  -  Air  Force  graduating  student  pilots  training  on  the  T38  aircraft; 

Group  3  -  experienced  pilot  instructors; 

Group  4  -  experienced  weapons  officers.  This  control  group  had  a  large  number 
of  flying  hours  comparable  to  the  instructors,  but  differed  in  that 
they  were  not  pilots; 

Group  5  -  civilian,  nonflying  control  subjects. 

Visual  test  results  are  listed  in  Table  1. 

Our  main  conclusions  are  as  follows.  For  advanced  student  pilots  (Group  2) 
good  predictions  of  low-visibility  landing  performance,  as  assessed  by  the 
number  of  crashes,  could  be  made  on  the  basis  of  the  antiphase  tracking  test. 
Figure  35  illustrates  this  finding. 

The  distance  from  the  runway  threshold  at  which  the  pilot  made  his  first 
flight  correction  correlated  most  strongly  with  the  results  of  the  inphase 
tracking  test.  In  particular,  the  better  the  pilot  performed  on  this  test, 
the  further  he  was  from  the  runway  when  he  made  his  first  flight  correction. 

This  finding  is  illustrated  in  Figure  36. 

At  first  sight  it  might  seem  surprising  that  we  did  not  find  strong 
correlations  between  any  of  our  various  contrast  threshold  tests  and  restricted- 
visibility  landing  performance.  In  extreme  cases,  very  low  contrast  sensitivity 
must  obviously  produce  poor  landing  performance  since  the  pilot  cannot  see  the 
runway  until  it  is  too  late.  Our  finding  can  be  understood  if,  in  the  particular 
groups  studied,  intersubject  differences  in  contrast  sensitivity  were  sufficiently 
small  that  they  were  not  a  dominant  factor  in  landing  performance.  Nevertheless, 
this  would  not  necessarily  indicate  that  existing  visual  tests  were  always 
successful  in  detecting  applicants  with  unduly  low  contrast  sensitivities. 
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Figure  35 

Relation  between  tracking  performance  and  the  number 
of  crashes.  Ordinates  plot  error  in  tracking  a  test 
square  whose  size  continuously  and  unpredictably 
changed  as  though  moving  in  depth .  Errors  in  the 
frequency  range  below  0.25  Hz  only  are  shown.  Abscissae 
plot  the  number  of  crashes  made  in  four  low-visibility 
landings  on  the  ASPT  simulator  (A-10  cockpit) .  Data 
for  12  graduating  student  pilots  are  shown  (linear 
regression) . 
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Relation  between  tracking  n erformance  and  the  distance  from  the 


runwag  threshold  at  which  vilots  made  the  first  flight  correction. 


Ordinates  plot  errors  in  tracking  a  test  square  that  moved 
unpredictably  in  the  frontoparallel  plane.  Errors  in  the 
frequency  range  below  0.25  Hz  only  are  shown.  Abscissae  plot  the 
distance  from  runway  threshold  at  which  the  first  flight  correction 
was  made.  Negative  distances  mean  that  the  pilot  has  passed  over 
the  threshold  before  his  first  correction.  Results  are  the  mean 
for  four  low-visibility  landings  on  the  ASPT  simulator  (A-10 
cockpit).  Data  for  12  graduating  student  pilots  are  shown 
(linear  regression) . 
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but  merely  that  our  groups  did  not  contain  any  individuals  with  20/20  vision 
or  better  accompanied  by  very  low  contrast  sensitivity.  (As  suggested  by  Dr. 
Ginsburg  elsewhere,  individuals  with  low  contrast  sensitivity  could  readily 
be  detected  by  adding  a  contrast  sensitivity  test  to  the  Snellen  acuity  test.) 

On  the  other  hand,  it  seems  that  motion- in-depth  tracking  and  sideways 
motion  tracking  did  measure  some  factor  that  is  of  dominant  importance  in 
restricted-visibility  landings,  and  also  shows  considerable  intersubject 
variability. 

This  research  is  described  in  Ref.  41  enclosed. 

Second  visit  to  Williams  AFB 

Although  the  conclusions  drawn  from  the  first  visit  were  based  on 
correlations  that  were  statistically  very  significant  we  felt  that  re-running 
the  study  on  a  different  occasion  with  different  groups  of  pilots  would  be  a 
useful  check.  Our  main  aim  in  this  second  study  was  to  confirm  or  deny  the 
conclusions  of  the  first  study. 

However,  we  also  took  the  opportunity  to  extend  the  scope  of  the  study. 

We  added  an  additional  psychophysical  test,  namely  visual  sensitivity  to  an 

expanding  visual  flow  pattern.  This  test  measured  ability  to  discriminate 

between  slightly  different  rates  of  expansion.  We  tested  a  slow  rate  of 

expansion  and  a  fast  rate.  We  envisaged  that  high  discrimination  on  this 

test  might  correlate  with  good  simulator  performance  on,  e.g.,  the  diving/bombing 

task  and  on  the  formation  flight  task.  For  this  test  we  used  a  portable  version 

28 

of  a  flow  pattern  stimulator  described  previously,  modified  to  be  controlled 
by  PET  microcomputer  using  the  psychophysical  method  of  constant  stimuli. 


The  simulator  test  was  expanded  to  constitute  a  "mission"  that  included 
the  following  tasks:  (1)  formation  flight  with  a  second  aircraft  (six  attempts); 
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Figure  37.  Environment  in  low-level  flight  task.  Small  dots  indicate 
cones  13  m  high  and  mall  triangles  indicate  30  m  pinnacles.  Large 
triangles  indicate  180m  hills.  Mountains  are  shaded !,  heights  given 
in  meters.  T  marks  target.  SAM  and  antiaircraft  artillery  (AAA) 
marked.  Dashed  line  shows  approximate  flight  path.  LLF  -  low-level 
flight.  Approximate  pop  up  point  parked  PO.  Scale  shows  distance 
in  kilometers. 
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(2)  low  altitude  approach  past  AA  guns  and  SAMs,  pop-up,  bomb  delivery  and 
exit  (Figure  37);  (3)  restricted-visibility  landings.  Performance  was 
measured  on  each  task,  and  performance  measures  were  successfully  obtained, 
for  every  subject  tested..  A  new  group  carried  out  the  simulator  test  in 
addition  to  advanced  student  pilots  and  pilot  instructors.  The  new  group 
comprised  12  F-16  operational  pilots. 

Our  main  findings  were  as  follows:  Simulator  flying  performance  was 
compared  with  the  results  of  sensory  visual  tests  for  12  student  pilots,  12 
instructor  pilots  and  12  fighter  pilots  and  aircraft  flying  grades  were  compared 
for  student  pilots.  Simulator  tasks  comprised  formation  flight,  low-level 
flight,  bombing  and  restricted-visibility  landing.  Visual  tests  comprised  super 
threshold  velocity  discrimination  of  a  radially-expanding  flow  pattern,  manual 
tracking  of  both  motion  in  depth  and  motion  in  the  frontal  plane,  motion 
thresholds  and  contrast  thresholds  for  a  moving  square  and  a  static  sinewave 
grating. 

Landing  and  formation  flight  performance  correlated  with  both  manual 
tracking  and  expanding  flow  pattern  test  results.  Pilots  who  were  better  able 
to  discriminate  different  rates  of  expansion  of  the  test  flow  pattern  achieved 
a  greater  percentage  of  hits  and  near  misses  in  the  low-level  flight  and  bombing 
task.  Aircraft  flying  grades  for  student  pilots  correlated  with  expanding  flow 
pattern  test  results  and  with  manual  tracking  of  motion  in  depth.  These  find¬ 
ings  suggest  that  tests  of  visual  sensitivity  to  superthreshold  motion  might 
usefully  be  added  to  current  selection  tests  for  flying  personnel.  These  find¬ 
ings  also  emphasize  the  importance  of  accurate,  artifact-free  representation 

of  motion  in  simulator  visual  displays.  These  findings  are  in  process  of 

...  42 

publ ication. 
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Extension  of  simulator  studies  to  real  aircraft 

We  have  extended  the  simulator  findings  to  real  aircraft  by  comparing  our 
laboratory  test  results  with  flying  performance  in  telemetry- tracked  high  performance 
jet  fighters  at  the  Yuma  TACTS  facility.  (This  study  was  made  possible  only  by 
excellent  cooperation  with  U.S.  Marines,  U.S.  Navy  and  TACTS  staff.)  Pilots  carried 
out  two  flying  tasks  using  A4  and  F-14  aircraft.  These  tasks  were  air-to-air  combat 
and  a  low-level  task  comprising  approach,  pop  up,  and  bomb  delivery.  Bombing  accuracy 
was  assessed  for  both  no-drop  computer  scoring  and  also  using  real  bombs.  Results  on 
our  motion  in  depth  tracking  test  and  on  our  expanding  flow  pattern  velocity  discri¬ 
mination  task  correlated  with  bombing  accuracy  and  with  success  in  air-to-air  combat. 
Pilots  also  carried  out  two  airborne  visual  tests.  These  comprised:  (a)  visual 
acquisition  range;  (b)  visual  judgement  of  whether  the  adversary  aircraft  was  turning 
left  or  turning  right.  These  test  results  also  correlated  with  bombing  accuracy  and 
success  in  air-to-air  combat.  These  findings  are  currently  in  preparation. 
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(f)  INTERACTIONS 

(1)  Spoken  papers  at  meetings  and  conferences,  1981-1982 

Regan,  D.  £  Cynader,  M.  Motion  in  depth  neurons:  effects  of  speed  and  disparity. 
ARVO,  Sarasota,  May  1981. 

Regan,  D.  The  relevance  of  channel  theory  for  the  design  of  simulator  imagery. 

Image  II  Conference,  Arizona,  June  1981. 

Regan,  D.  Comparison  of  transient  and  steady-state  methods.  New  York  Academy 
of  Sciences,  June  1981. 

Regan,  D.  New  thoughts  on  evoked  potentials.  Invited  address  to  Second  Intnl. 
Evoked  Potentials  Symposium,  Cleveland,  Ohio,  October  1982. 

Regan,  D.  The  role  of  size  changes  and  texture  in  motion  perception.  Assn,  for 

Research  in  Vision  5  Ophthalmology  annual  meeting,  Sarasota,  May  1982. 

In  addition,  D.  Regan  has  given  invited  lectures  at  the  following  Military 
Establishments,  Universities  and  Hospitals: 

Universities  of  New  York,  M.I.T.,  Utah,  Concordia  (Montreal),  Manitoba,  McGill, 
Montreal  Neurological  Institute. 

Williams  AFB  and  MCAS  Yuma,  Arizona. 

Alberta  Heritage  Foundation  Visiting  Professor  and  lecturing  at  the  University 
of  Calgary  and  Foothills  Hospital. 

(2)  Consultative  and  Advisory  Functions 

Dr.  T.  Longridge  of  Williams  AFB  AFHRL  and  Mr,  R.  Kruk,  Dr.  K.  Beverley 
and  Dr.  D.  Regan  of  Dalhousie  University  are  jointly  carrying  out  a  study  of 
vision  in  pilots.  Mr.  Kruk  has  been  carrying  out  visual  measurements  (including 
changing-size  sensitivity  and  changing-size  tracking  performance)  on  trainee 
and  experienced  pilots  at  Williams  AFB,  and  comparing  these  data  with  flying 
grades  and  simulator  performance  on  formation  flying.  We  are  now  liaising  with 
Mr.  J.  Taylor  of  Yuma  TACTS  in  order  to  extend  the  implications  of  our  two 
studies  on  the  Williams  ASPT  flight  simulator  to  pilot  performance  in  radar-tracked 
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aircraft.  In  particular,  we  are  correlating  individual  differences  in  dynamic 
visual  sensitivity  with  pilot  performance  in  several  flying  tasks  including 
air-to-air  combat  manoeuvres,  low-level  approach  and  weapons  delivery  and 
formation  flight. 


(g)  NEW  DISCOVERIES,  INVENTIONS  OR  PATENT  DISCLOSURES  STEWING  FROM  THE 
RESEARCH  SUPPORT 

there  has  been  no  further  invention  since  the  mot ion -in -depth  tracking 
technique  that  we  reported  previously  and  was  then  patented  by  the  U.S. 

Air  Force .  .  ' 
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